Papers with instant scorer
Instantly Learning Preference Alignment via In-context DPO (2025.naacl-long)
Copied to clipboard
| Challenge: | Presently, mainstream approaches to HPA heavily depend on fine-tuning . however, the huge computational and annotation costs of fine-timing are hard to ignore . |
| Approach: | They propose a tuning-free approach to HPA using LLMs' decoding . they first rethink the derivation procedures of DPO and build an instant scorer . |
| Outcome: | The proposed approach outperforms existing methods even with tuning-free baselines and an upgraded scorer. |